New Methods for Solving Large Scale Linear 
Programming Problems in the Windows and 
Linux computer operating systems 



Saeed Ketabchi * Hossein Moosaei Hossein Sahleh * and Mohammad Hedayati § 

September 20, 2012 

This paper will be published in Appl. Math. Inf. Sci. Vol. 7 No. 1 (2013) 

Abstract 

In this study, calculations necessary to solve the large scale linear programming prob- 
lems in two operating systems, Linux and Windows 7 (Win), are compared using two 
different methods. Relying on the interior-point methods, linear-programming interior 
point solvers (LIPSOL) software was used for the first method and relying on an aug- 
mented Lagrangian method-based algorithm, the second method used the generalized 
derivative. The performed calculations for various problems show the produced random 
in the Linux operating system (OS) and Win OS indicate the efficiency of the performed 
calculations in the Linux OS in terms of the accuracy and using of the optimum memory. 
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Linux operating system, LIPSOL, Windows operating system. 

1 Introduction 

Linear programming (LP) is an important class of optimization problems and is used extensively 
in economics, operations research, engineering, and many other fields. 
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In this paper we consider the primal linear programming in the standard form 



/* = minc T x, X = {x G R n : Ax = b, x > 0}, 



(P) 



where A G R mxn , c G R n , and b G R m are given, x is primal variable, 0j denotes the i- 
dimensional zero vector. In this work we present two methods for solving problem (P). The 
first method -which is a Matlab-based package for solving linear programs by interior-Point 
methods- is LIPSOL (the function linprog in Matlab). The second method is based on aug- 
mented Lagrangian method. [31 HI El H2] 

Initially, some problems with different sizes are produced randomly through providing gen- 
erated problem and then calculations are done in the Win OS. Though the second algorithm 
enjoys a higher efficiency than MATLAB LINPROG according to the results, it cannot solve 
the large-scale problems. Now, the operating system is changed from the Win to the Linux 
and the produced problems are solved using both methods in the Linux OS. It can be observed 
that the unsolved problems by the Win OS are solved by the Linux OS. These results show the 
higher efficiency and flexibility of the Linux OS than the Win OS to make calculations and to 
solve large scale problems using various methods. 

This paper is organized as follows. Augmented Lagrangian method is discussed in the 
section 2. In Section 3, some examples on various randomly generated problems are provided 
to illustrate the efficiency and validity of our proposed method. Concluding remarks are given 
in Section 4. 

In this work by A T and |.| we mean the transpose of matrix A and Euclidean norm respec- 
tively and a + replaces negative components of the vector a, by zeros. 

2 Augmented Lagrangian Method 

In this section we consider problem (P). Assume that the solution set X* of primal problem 
(P) is nonempty, hence the solution set U* of dual problem is also nonempty, and x G R n be 
an arbitrary vector. Next Theorem tells us that we can get a solution of the dual problem of 
(P) from the unconstrained minimization problem . 

Theorem 2.1 Assume that the solution set X* of problem (P) is nonempty. Then there exists 
a* > such that for all a > a* the unique least 2— norm projection x of a point x onto X* 
is given by x = {x + a(A T u(a) — c)) + where u(a) is a point attaining the minimum in the 
following problem: 



min a, x) 



(1) 
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where a, x) = —b T u + ^- || (sc + a(A T u — c)) + || 2 . In addition, for all a > and x G X*, 
i/ie solution of the convex, quadratic problem (QJ), = u(a) is an exact solution of the dual 
problem i.e. u(a) G E7*. 

The proof is given in [3]. 

Now, we describe how can be solved the unconstrained optimization problem ([I]). The 
function §(u,a,x) is augmented Lagrangian function for the dual of the linear programming 
(P) (see HI), 

/* = max b T u, U = {ueR m : A T u < c} (D) 

The function is piecewise quadratic, convex, and just has the first derivative, but 

it is not twice differentiable. Suppose u and s G R m , for gradient of a, x) we have 

\\V®(u,a,x) - V$(s,a,x)|| < || A\\ \\A T \\ \\u - s\\, 

this means V$ is globally Lipschitz continues with constant K = \\A\\\\A T \\. Thus for this 
function generalized Hessian exist and is defined the m x m symmetric positive semidefinite 
matrix El [9] 

V 2 $(w,a,x) = AD(z)A T , 

where D(z) denotes an n x n diagonal matrix with i-diagonal element z t equals to 1 if (x + 
a(A T u(a) — c)i > and equal to otherwise. Therefore we can use generalized Newton method 
for solving this problem and to obtain global termination we must use a line-search algorithm 
(see [lO]). In the following algorithm we apply the generalized Newton method with a line- 
search based on the Armijo rule [2]. 



Algorithm 2.2 Generalized Newton method with the Armijoo rule 

Choose any u G R m and e > 
i=0; 

while HV^Uj)^!! > e 

Choose oti =max{s, s5, s5 2 , ...} such that 

<$>(ui) - <$>(ui + cadi) > -o^V^UiK, 

where di = -V 2 $(n i ) _1 V$(n i ), s > be a constant, 5 G (0, 1) and fi G (0, 1). 
u i+ i = Ui + audi 
i = i + 1 ; 
end 
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In this algorithm, the generalized Hessian may be singular, thus we used a modified Newton 
direction as following: 

-(V^tO+Wm)- 1 ^^), 

where 5 is a small positive number (5 = 10~ 4 ), and I m is the identity matrix of m order. 
Now we introduce the following iterative process (multiplies method for the dual LP problem 
(D)): 

u k+1 = org mm{-b T u + || (x k + a(A T u - c))+ II 2 , (2) 

where x° is an arbitrary starting point and the solution of the problem ($2§ has been obtained 
by algorithm (12. 2p . 

Theorem 2.3 Let the solution set X* of the problem (P) be nonempty. Then, for all a > 
and an arbitrary initial x° the iterative process ^\), ([3|) converges to x* £ X* in finite number 
of step k and the primal normal solution x* was obtained after the first iteration from above 
process, i.e. k — 1. Furthermore, = u k+l is an exact solution of the dual problem (D). 

The proof of the finite global convergence is given in [1] 

3 Numerical results 

In this section we present some numerical results on various randomly generated problems 
to the problem (P). The problems are generated using the following MATLAB code: 



°/ lpgen: Generate random solvable lp: min c'x s.t. Ax = b ;x>=0, 
°/ Input: m,n,d(ensity) ; Output: A,b,c; (x, u) : primal-dual solution 
m=input ( ' Enter m : ' ) 
n=input ( ' Enter n : ' ) 
d=input ( 'Enter d:') 
pl=inline ( ' (abs (x) +x) /2 ' ) 

A=sprand(m,n,d) ;A=100*(A-0.5*spones(A)) ; x=sparse (10*pl (rand(n, 1) ) ) ; 
u=spdiags( (sign (pi (rand(m, 1) -rand (m, 1)))) ,0,m,m)* (rand(m, l)-rand(m, 1) ) ; 
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b=A*x; c=A ) *u+spdiags ( (ones (n, l)-sign(pl(x) ) ) , ,n,n) *10*ones (n, 1) ; 
format short e ; [norm(A*x-b) , norm(pl (A ; *u-c) ) , c'*x-b'*u]. 



The test problem generator generates a random matrix A for a given m, n and density d and the 
vector b. The elements of A are uniformly distributed between —50 and +50. In all computa- 
tions were performed, our variant augmented Lagrangian method and the generalized Newton 
method and Armijo line search, were implemented in MATLAB code. We used Core 2 Duo 2.53 
GHz with main memory 4 GB. The computation results are shown in Table(l) and Table (2). 
We present comparison between the method is based on LIP SOL ( see [TT]) in MATLAB 
(linprog) and our algorithm (lpf ) in Windows and Linux . 

Computational results show that, some of the unsolved problems in the Win OS are solved in 
the Linux OS. 

The starting vector used in all following examples is x° = 0. In all solved examples a = 
10 / cf°' 5 , tol = 10 -10 . The total times of computations in each example is given the third col- 
umn of the table. The accuracy of optimality conditions of LP problems are in the last three 
columns. 



4 Conclusion 

Two methods have been offered in this paper to solve linear programming problem. Initially, 
some problems are produced randomly and then they will be solved by two offered methods in 
the Win OS. Though the second algorithm enjoys a higher efficiency than MATLAB LINPROG 
according to the results, it cannot solve the large-scale problems. Then the produced problems 
are solved using the both methods in the Linux OS, the results show that some of the unsolved 
problems in the Win OS are solved in the Linux OS. 
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Table 1: Comparison of linprog and lpf in Win 



m, n, d 




time(sec) 


1 \ x *\\ 


|| AC* — felloe 


\\(A T u* - c)^ 


\c T x* — b T u*\ 


800, 1000, 1 


linprog 






Out of memory 






lpf 


26.06 


1.3250e + 001 


4.6280e - 009 


1.3358e - 012 


2.2695e - 008 


1000,1200,1 


linprog 






Out of memory 






lpf 


45.91 


1.3072e + 001 


5.8478e - 009 


1.7586e-012 


-1.6425e-008 


800, 10000, 1 


linprog 






Out of memory 






lpf 


97.20 


9.0806e + 000 


1.1331e-008 


5.6843e - 013 


8.8519e -008 


2000,30000,0.1 


linprog 


162.51 


3.2136e + 001 


1.2335e-008 


5.79e - 013 


5.82e - 007 


lpf 


29.31 


13.372 


3.9063e - 009 


6.8212e-013 


-5.6716e - 009 


3000,4000,0.1 


linprog 






Out of memory 






lpf 


87.35 


1.3993e + 001 


8.2518e-009 


8.5265e - 013 


4.9171e -008 


10000,15000,0.01 


linprog 






Out of memory 






lpf 






Out of memory 






10000,150000,0.01 


linprog 






Out of memory 






lpf 






Out of memory 






100,10000000,0.01 


linprog 


814.07 


1.1705e + 005 


4.0059e - 007 


1.00e-007 


1.82e-001 


lpf 


218.86 


4.3655e - 001 


2.0084e - 007 


7.1054e-015 


-2.8666e - 007 



Table 2: Comparison of linprog and lpf in Linux 



m, n, d 




time(sec) 


1 \ x *\\ 


|| Ac* — felloe 


\\(A T u* - c)^ 


\c T x* — b T u*\ 


800, 1000, 1 


linprog 


45.84 


1.8190e + 01 


3.4152e- 10 


8.01e- 13 


4.97e - 06 


lpf 


23.83 


1.3250e + 01 


4.6280e - 09 


1.3358e - 12 


2.2695e - 08 


1000,1200,1 


linprog 






Out of memory 






lpf 


44.59 


1.3072e + 01 


5.8478e - 09 


1.7586e - 12 


-1.6425e-08 


800, 10000, 1 


linprog 






Out of memory 






lpf 


90.41 


9.0806e + 00 


1.1331e-08 


5.6843e - 13 


8.8519e -08 


2000,30000,0.1 


linprog 


161.72 


3.2136e + 01 


9.4724e - 10 


5.78e - 13 


5.82e - 07 


lpf 


34.65 


13.372 


3.9063e - 09 


6.8212e - 13 


-5.6716e - 09 


3000,4000,0.1 


linprog 


291.53 


2.3014e + 01 


6.4369e - 10 


1.02e- 12 


9.65e - 09 


lpf 


113.95 


1.3993e + 01 


8.2518e-09 


8.5265e - 13 


4.9171e -08 


10000,15000,0.01 


linprog 






Out of memory 






lpf 


3243.50 


1.4390e + 01 


6.0431e-09 


3.1264e - 13 


-1.2012e - 07 


10000,150000,0.01 


linprog 






Out of memory 






lpf 


4215.10 


5.5538e + 01 


1.1173e + 05 


1.1108e-01 


3.8562e + 05 


100,10000000,0.01 


linprog 


212.72 


1.1705e + 05 


4.4343e - 07 


1.00e-07 


1.82e-01 


lpf 


140.01 


4.3655e-01 


2.0084e - 07 


7.1054e- 15 


-2.8666e - 07 
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